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Ethnographie Auditing^ A N#w Approach to Evaluatlno Management 

in Higher Edugation 

Management is assuminQ an ineraasingly important role in higher 

©duQation. Univeraitiea and coUegai throughoyt the United States are 

becominQ aware of the importance of managing their limited raaources 

effeotiveiy and efficiently. Fiscal consoiouiness railing was prompted 

initially by declines in the national economy and the coniequent drop in 

faderal ipending. Educational institutions entered a period of 

retrenehment in the late 70's < Bouien 19791 Mayheuj 19781 Riesman 1979; 

Wolotkiewio^ 1980). Many Institutions responded to difficult fiscal 

times with arbitrary budget cuts and wholesale elimination of non-'core 

programs and of departments with low enrDllments < Jedamus , Peterson, and 

Associates 1 980 i McCorkle and Archibald 1982). 

Educational institutions are now enterinfl a new and more positive 

phase in their confrontation with fiscal realities. This phase is 

charaaterized by a striving towards eKcellence. Universities are 

attempting to increase operational productivity in quantity and quality 

(Sarvin 1980; Hopkins and Massy 1981; Karol and Ginsburo 19801 Uan 

Maanen 1983; yolotkiewicz 1980). In this pursuit toward excellence, both 

evaluation and auditing have been useful in streamlining operations and 

increasing productivity. Although evaluation and auditing differ in 

their guiding principles and topic interests, they share a common goal - 

the improvement of the educational institution. Auditina is, in 

essence, a form of educational evaluation. To bridge the overarching 

concerns of educational evaluators and management, however, auditing 

must adapt. The purpose of this discussion is to introduce ethnQgraphic 

auditing as a new approach to evaluating management in higher education. 

Auditing from an ethnoQraphic perspective increases our understanding of 
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the culture and climate of an educational institution. The ammm studies 
presented in this discussion illustrate hou? ethnographic auditing has 
beaana an instrumental means of measuring and ihaping the ef f ect iyaneis 
and effieienay of management in higher education. 

Ethnographic auditing is the application of ethnoflraphic or 
anthropoloQicfll concepti and methods to the appraisal of administrative 
controls over organiiat ional resources. By adopting an athnographic 
auditing approach, the evaluator can focui on resource control ^ a topic 
that is fundamental to sound management. 

The value of ethnography in educational research has b^en 
demonstrated in collections such as Ithnoaraphv in Educat ional 
Evaluation <Fetterman 1984) and Educational Evaluation^ Ethnooraohv in 
T_heQry_^ Practice . and Politics (Fetterman and Pitman ISSB). Ethnoflraphic 
techniques are UBmful in describing hota a program ujorks - the prQcessei 
and interrelationships of program practice. In addition, the case for 
qualitative approaches in educational research is convincingly made in 
ujorks such as Qualitative Evaluation Methods (Patton 1180), Qualitative 
Data Analvsis (Miles and Huberman 1984), and Introduction to Qualitative 
Research Methods (Taylor and iogdan 1984). 

Traditional quantitative techniques such as psychorietric testing 
are appropriate for assessing certain educational outcomes in the 
classroomp Cost benefit analyses represent useful contributions to 
assessing the relative worth of the educaticnal "treatment". Auditing 
has an older and less popular — tradition in educational 

administration and evaluation. Typically, auditing is categoriied as 
fiscal or ©perational in nature. Fiscal auditing focuses on accounting 
and compliance issuess the emphasis is on establishing accuracy in 
financial reporting. Operational auditing subsumei fiscal auditingi it 
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foeusei on aueh adminiitrafeiv# aoncerns th© dypllaatioh of resoureei , 
traniaction flows, and bottlenecks in the system. Staffing levels and 
budgetary controls are alio overarGhing concerns of the operational 
auditor (see Saujyer 1i81i Ritternberg 1977). 

Ethnography and auditing have ^aoh been used to deaoribe and 
evaluate management. Suba (iSSI), Halpern (1983), Lincgln and Sufaa 
(1382 ), and Schuiandt and Halpern < 1 984 ) have dlscuaied the role of 
auditing ai a tool to ensure the credibility of findings CQllected using 
a natural i at ic inquiry approach. Unfortunately , individually , these 
approaches fall short of meaauring the effectiveness and ifficiency of 
management, Thia discussion combinea ethnography and auditing to 
deacribe a mora comprehensive approach to evaluating univeraity 
management, Togethar theae two methods of asaassment form a 
qualitatively different approach to the atudy of higher education. On 
the one hand, applying an ethnographic approach to audit concerna both 
tranacenda fiscal auditing and improves operational auditing, Dn the 
other hand uaing audit concerns aa a focal point for ethnographic data 
collection and analysis increases the relevance of the evaluator^a 
findings and recommendat iona . A syntheaia of the two approachea 
provides a new conceptual outlook toward the evaluation of management. 
The introduction of ethnographic audi+^ng ia a conscioua effort to 
redirect reaearch in higher education* An anthropological orientation 
enables the evaluator to capture t,he multiple realitiea of univeraity 
life. Ethnographic auditing focuaea on management-a ability to plan, 
analyse, supervise, communicate, and generally to control resources. 
This approach addreases often neglected but fundamental eiementa of the 
daily lives of managers in postsecondary inst i tut iona . 

3 



5 



This research is basad on over five y^r ^ of judit from an 

anthropological perspective at Sianfor rt j. - ty ^nd other 

institutions of higher edycation in m ^'^ anea : t"-'? chemistry 

department, physics department, library^ #: -juf*^ vabie, personnel, a 
teaching hospital pharmacy and emergency i^p -ment ui^eP ^ etterman 1386 
for an illustration of ethnographic auditi. y n :ihe- dapart ment s ) , and 
a linear accelerator. ithnographic a^.^ . , .ighl^ghts the role of 
culture, subculture, values, rituals, ar S4.cal environment in 

management in higher education. In adriition.^ ethnographic auditing 

demonstrates the economic consequences of adopting various philosophical 
orientations or world views, the role of management informatior, systems, 
the value of data bases for decision making, and the roles of judgement, 
institutional life cycles, and honesty in management. Ethnographic 
auditlno can improve management and, in the process, facilitate the 
institutional academic mission. 

Q^^dinq Principles- Appraisal . DaacripLion. and CuntrGl 

Ethnographic auditing combines elements of ethnography, evaluation, 
and auditing. ithnographic methods of description and anthropological 
concepts guide inquiry and interpretation. Evaluation is used to make a 
Judgment or appraisal of the system under study, As a subdi sc ipl ine 
within evaluation, auditing focuses on resource control and provides an 
opinion on existing fiscal and operational controls in an organization. 

l^s in ethhography, operational auditing requires a survey period in 
which the auditor determines the most important areas of investigation, 
in addition to those routine or already prescribed areas. This survey 
is a typical ethnographic, grounded theory approach (Slasaer and 
Strauss, 1987), The auditor must develop a proposal including a time 
line and budget to accomplish the objectives presented in the proposal. 
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As In contraat rmmmmrch , the auditor then enters into nefletiation with 
managers or directors to determine the amount of time to be budgeted and 
the methodology to be used* Jhm end product i a a p Ian to asaeas t he 
degree of control a departmental manager, director, or chairperson has 
aver operations = whether on the academic or on the businegs side of the 
university. 

The auditor borroujs methodology for thig study Prom various fields 
inoluding evaluation and psychology. Random samples are used to test 
attributes of a population. Discovery sampling are uied to Identify a 
particular entity or problem. Judgment sampling, or purposive sampling, 
along with interval sampling are probably the most commonly used set of 
tools in auditing. In general, as in evaluation, the auditor's Judgment 
takeo precedence over statistical sampling. Most of the data are 
recorded on spread sheets in a tick and check fashion. This is a vestige 
of auditing's origin in the aGcounting or financial side of 
organizational study. In addition, budget calculations and inventory 
calculations are routine. Increasingly, ethnographers and other social 
science academics are being hired to m alyza the processes in a 
department from a systems perspective. These systems analysts determine 
whether any "act t lenecks " , dysfunctional organizational structures, 
and/or conflicting cultural values eKist that inhibit day-to-day 
operational activity or productivity. The ethnographie auditor — like 
the systems analyst — is an outsider, a position that gives the 
individual greater objectivity. ^n ethnographic audit looks at both the 
financial and operational components of management. Organizations pick 
up bad habits much the ujay that individuals do, and mansiement needs to 
become aujare of these habits. The ethnographic auditor measures the 

5 

7 



fiscal and operational backbone of an orflanizatlori within its own 

cultural conteKti This aasaiam^nt is critical if the organization Is to 

1 

accompl ish Its aaademic mlsiion , 
Fqrni4inv§ Evaluation 

Auditing is a formative evaluation of the manaflemant proaeas in the 
educational institution, (Audits are ongoing evaluations of managenient ' s 
ability to plan and analyze departmental data for decision making. 
Planning and analysis may range from budget forecasting to calaulating 
staffing levela and equipment needs. Ideally, the operational auditor 
aerves aa a managment consultant - aiding and assisting managment (sea 
Matthews 1983). The auditor communicates findings throughout the study 
by means of the audit memo. These memos identify key concerns and test 
Interpretaticns of events or activities* Many problematiG concerns can 
be remedied before the final report is issued and therefore need net 
appear in the final report. Minor infractions invoiving compliance 
issues such as an expiration date on a piece of equipment, a minor 
bookkeeping error regarding a par value or number of stock, or a 
potentially embarrassing personnel problem can be remedied in the course 
of an audit and in the process a healthy rapport can be established. At 
its worst, auditing is merely a compilation of compliance issues 
regarding university and federal rules and regulations. At its best, it 
is an essential guide and check on management. 

Auditing looks for manifestations of meaning, cognition, 
competence, and quality. Auditing speaks the language of management: 
translating budgets, ledgers, equipment rosters, and numerous other 
forms of fiscal information into pragmatic assessments of the present 
and recommendations for the future. In an educational Institution, 
management is the support mechanism that enables the departments to 
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pursue their given academic mission suceessf ully . Auditing tests the 
ability of this infrastructure to support the 'educational process. 

There are many kinds of auditors. One is the stereotypic ominous 
IRS agent ujho reviews taKes, Another kind is an e>^ternal auditor, ujho 
is called in to study almost exclusively the fiscal side of an 
organization's operations. Then there Is the internal auditor or 
operational auditor or management consultant (see Sauiyer 1981, irink 
1982, and Rittenberg 1977 for a revieui of modern internal auditing). 
This individual works for the institution, where the tax auditor or the 
exterrial auditor works for an external agency, As a result, the 
internal auditor has accets to all facets of the organisation. Senior 
management benefits from the internal auditor's assessment of their 
operation and supports their efforts - often to proiect themselves from 
external inspections, evaluations, and audits. During an audi t senior 
management generally sends the word out to the staff that they, are to 
hold nothing from the internal auditor. As long as the internal auditor 
demonstrates that he or she is there to help management, information 
flows frat^ly. In fact, the auditor has immediate access to information 
not made privy to most evaluators or ethnographers. Moreover, auditors 
work on site every day, much as an ethnographer does, becoming immersed 
in the daily operations of a department. The audit process opens up all 
sorts of information that reflects the realities of daily operations. 
When the internal auditor acts merely as a compliance expert, however, 
the flow of information dries up rapidly — regardless of the signals 
from senior management . 

Unfortunately, the label "auditor" carries a general stigma 
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CGoffman 1 iS3 ) . Most individuals unaGquainted with the role of the 
internal auditor lump all auditori together* They forgftt that 
intraculturai diversity a?<i§ti ujithin ail groups, A second problem 
invalves the laui of diminishing returns — which applies to auditing as 
it does to evaluation and ethnography. Individuals have a limit to the 
amount probino and testing they can tolerate. Time, eMperienae, and 
open discussion are raQyired to dispel mi spercept ions and Inaecurate 
assumptions. The auditor's, evaluator's, or anthropologist's 
professional judgment will almays be the most significant factor 
determining acceptance in the field, 
auditing^ Contribution Management 

From the auditor's perspective, the most significant variable of 
management's function uithin an operation is control. Does management 
have control of its operation? Control requires valid and reliable 
data, checks and balances, and security, Accountability is fundamental 
in management. It is important to identify the location of a problem 
when it arises as soon as possible if the organization is to be placed 
back on course, iuilt-"in mechanisms of accountability allow management 
to monitor and test old and innovative approaches. The security of 
knowing that the ship is on course allows management to fulfill its most 
important function - looking toward the future, Auditing focuses on 
such operational components as a department's operational efficiency 
(ineludlng productivity), planning and analysis, data for decision 
making (management information systems), supervision, workspace, staff 
development, and various other manifestations of the quality of 
management such as record keeping practices^ The auditor evaluates 
management on its own terms. Auditing adds an insight as well into the 
baakbone of an organisation, using rigorous procedures that are both 
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undarstood and accepted by those being evaluated, 

EthnQqr§Ph»^ f^uditinQ^a ContributiQn Management 

Undarat^andino hoy management thinki or simply what makes management 

tick is at the core of ethnographic auditing. ithnographic auditing 

evaluates management on a eultural level of analysis. Every 

2 

oroanization has a culture. Organizational culture typically consists 
of shared knoujledge about spaeific status levels, overlapping 
hierarchies, specific languages, sacred symbols, rituals, and behavior. 
"A strong culture Is a system of informal rules that spells out how 
peaple are to behave most of the time" (Deal and Kennedy, 1982, p. IS), 
Cultural knomledge is the information an individual requires to function 
uithin an organization, An anthropologist studies a culture to learn 
the insider's cultural knou/ledge and so better understand the patterns 
and processes of that culture. Similarly, the auditor yho approaches an 
audit from a cultural perspective learns the cultural knowledge that 
underlies organisational behavior. The evaluator who combines the 
auditor's concern over resource control with ethnographic or qualitative 
methods is able to address the more penetrating management issues in 
higher education. 

As the central locus of instruction and research, a university or 
college is a distinctive part of the larger academic culture. In the 
university environment, efficiency and sound fiscal planning must be 
weighed against the need to provide an environment conducive to 
education and exploration, Uiewing a university from a cultural 
perspective rather than exclusively from a compliance orientation 
improves an audit or evaluation. Conceptually, a cultural orientation 
reinforces an operational audit and broadens educational research in 
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administration. It provides conQepts to guid# inquiry and 
interpretation, MethodoloQically., a Gultural approach offeri effective 
teohniqu#9 to conduct operational auditi in the lame manner in uihich 
they have been applied to evaluation (see Fetterman, 1980, 1 e84a , 
ii84bi Fetternan and Pitman ^ in press). Anthropoloflical methods of 
particular value in auditing and administrative research in higher 
education are presented throughout this discussion. These techniques 
include participant observation (Pelto, 1970| Spradley. 1980). key 
informant interviewing (Spradley and McCurdy , 1972 ). informal and 
structured intervleuis , expressive autobiographiaal Intervieys (Splndler. 
1970). and tr iangulat ion (Webb. Campbell. Schujartz , and Seohrest . 1988). 
In addition, the folloujing unobtrusive measures may be usedi physical 
traces, archives, folktales. proKemics (Hall. 1986), and questionnaires. 
In each of the cases illustrated in this dlsaussion. the auditor's 
concern with resource control has been merged with a cultural 
interpretation of events and anthropological techniques. This approach 
has proved useful in Identifying the problem. collecting the data. and 
analyzing or interpreting the data. 

The anthropologist's cultural approach drays attention to the 
systems level of analysis. This view illuminates the interconnected 
nature of a department or an entire university. Functional and fiscal 
relationships are intertwined entities. In addition, the cultural 
perspective focuses on the structure and values of an organi zat ion . 
They shape the behavior of professors, administrators, students. and 
staff. ^doptino this perspective enhances the relevance of findings for 
the auditor or evaluator. Finally, understanding the cultural context 
of the evaluated program increases the probability that the client will 
accept both the evaluation findinga and the evaluator's recommendations. 
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Auditlno a university on a cultural level requires attention to 
both specific practices and underlying systems. The auditor or 
rgsaarcher must study specific -dharge documents, productivity 
statistics, CQmputer use, personnel records, work space conditions, 
health and safety concerns, procurement transactions, cash handling 
controls, as well as equipment, payroll, and travel controls. These 
specific mechanisms are manifestations of underlying systems, including 
operational efficiency, planning and analysis, supervisory structures, 
and information systems. These fundamental systems and processes lie at 
the heart of university culture. 

Case Studies 

Case studies provide a graphic means of Illustrating ethnographic 
auditing's contribution to the improvement of management, Tujo case 
studies — the University Library and the Chemistry Department — 
illustrate the utility of ethnographic auditing and the role of cultural 
data collection and interpretation in educational administration. In 
addition, the role of philosophical orientations, the usa of management 
information systems, supervision, leadership, the physical environment, 
and fiscal communicat ion in management are discussed. Due to the 
sensitivity of auditing information, houiever , sensitive ur confidential 
details of each case study have been omitted. In addition, a discussion 
of these findings was delayad until the problems were rectified or 
significant parties had transferred to new positions. This presentation 
emphasizas basic general i sable patterns and descriptions. 
University Libr-arv 

One of the Associate Directors of the University Library 
requested our assistance to evaluate the effectiveness and 
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efficiency of the. Library's Technical Services division, Teehnical 
Services is composed of three departments: Acquisitions, Cataloging, 
and Serials, The Acquisitions Department houses five units: 

Search and Order, Pracessing and Receipts, Gifts and Exchange, 
Binding and Finishing, and Conservation, The first three 

units are responsible for acouiring titles to be processed by the 
Catalog Department, The last two units are concerned with the 
phyaiaal preservation of monographs and serials. 

The Catalog Department houses ten units. The tuio largest units 
are Copy Cataloging and Monographic or Original Cataloging. Copy 
Cataloging receives the b ibl iographic data required to aatalog the 
monographic titles from the Research Library Information Netuiork 
(RLIN) system. They process the largest number of titles that enter 
the library. Copy Cataloging is conducted by staff level employees. 
The Original Cataloging un^t processes all monographic .. titles 
that do not have Library of Congress or RLIN bibliographic data. 
This involves the intellectual effort of conducting authority ujork and 
properly classifying and processing a title. Original cataloging is 
conducted by professional level employees. This is, of necessity, a 
high cost, louj numerical output unit. The other units in the Catalog 
Department include: Music Cataloging, Special Collection Cataloging, 
Meyer (undergraduate library) Cataloging, Added Copies/Volumes, Filing 
Maintenance, Transfer/Cancel, and a grant project. 

The Serials Department is responsible for acquiring and 
cataloging serials such as journals and other continuing titles. The 
department is composed of a Serials Racords division and Serials 
Cataloging division. The Serials Records division is composed of 
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the Procurement and Receipt Unit and the Continuations 

Maintenanw*?* Unit, The Serials Catalog Division ii composed oft an 
Original Cataloging Unit, a Copy Cataloging Unit, a Database 
Malntanance Unit, and a Special Materials Catalogino Coordinator. 
Ths. tMMMMMMmX 

Tha overall ass^asment wai not positive. There ujare a number 
of problems thet warranted attention. The problems ranged from a 
poor conaeption of the institutional misiion to conflicting 
uorld vieujs and value systems^ 

The core of the problem usas that the library had a weak and 
fragmented cultural system. There waa no central conception of 
purpose. The library had lost their mission in a mazeyay of departments 
and a labyrinth of processing and catalogino rules and regulatiani. 
The ethnographic audit findings uiere useful in revitalising the 
library's cultural system by reminding management and staff of their 
mission. The auditors provided a simple mechanical model of their 
operations to assist them in defining their purpose. In 
essence, the ethnographic audit attempted to make explieit their 
implicit cultural rules and values. 

Technical Services is a complex production system. Its 
operations are based upon an implicit, systems approach. 
Industrial engineering terms facilitated communication with 

management. Their system ujas defined in terms of: inputs that are 
passed through a conversion process to provide outputs. In Teohnical 
Services, a title is passed through a series of conversion 
processes, defined in the Catalog Department, and packaged in the 
Binding and Finishing Department, The processing is complete when the 
title is placed on the library shelves for use. The output is a 
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properly hound, cataiogued tltla phyeically accesgibla to a user. 

There are, of course, many sub^routines within each component of the 

system's flow pattern* This was, however, their basic mission — the 

cultural thread that held them together. 

In this fragmented cultural system each of the departments and 

subunits represented subcultures. Their poorly defined cultural 

system was confounded by subcultural conflict. 

All companies have subcultures, because functional 
differences. . .single out special aspects of the business 
environment . 

.p.Each has its own relevant environment and world view; 
special heroes, rituals, ceremonies, language, and 
symbols communicate particular values. Subcultures can 
shape beliefs and determine behaviors in much the same 
way that culture can. " (Deal and Kennedy 1982, p, lEl). 

From an audit or evaluation perspective, the library management paid 

insufficient attention to the efficient coordination of production 

operation details and the summative effect of a unit or department*s 

processes and procedures on the whole system. Translated into 

cultural language, the subcultures clashed and produced maladaptive 

behavior patterns, e.g, low morale and productivity. This problem was 

discovered fay using such techniques as key informant interviaws , 

informal interviews, expressive autobiographical interviews, archival 

materials, and listening to folktales about the library from various 

librarians* The original catalogers represented the most vocal and 

ant i^main^tream subculture. They provided detailed accounts of what 

they perceived as personal injustices Inflicted on them by management. 

They had their own anti^lihrary heroes who had won grievances with 

library administration* The folktales generated from these events were 

shared with the ethnographic auditor to highlight *heir individual 

complaints* Heroic figures in the subculture were extremely articulate 
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key informants who provided vivid accounti uf their life in the library, 

often exteniively documented. ' Their autobiographical accounts focuaed 

on their profasiional clashes with managament* Archival data, such aa 

neyspaper articles yera also useful in documenting the problem. Many of 

the librarians had repeatedly voiced their displeasure ujith 

managernent in the campus neuispaper over the years. They described the 

working climate as oppressive and hostile. In addition, an 

overwhelming number of grievances stemmed from this subculture. 

The grievance documents represented another useful archival data source 

to triangulate individual reports. Interviews with manaoement were of 

value in placing this problem in an institutional context. Hanagement 

was attuned to this problem beaause they had for several years perceived 

this subculture as ripe for unionisation. 

subcultures can be very dastructive in weak cultural 
environments. When the corporation's values are 
impossible to undarstand, a subculture can dictate 
behavior, and eventually cause a sort of cultural drift 
in the company (Deal and Kennedy 1902, p. 152). 

Library staff and managament shared few values. In fac-t , value 

conflict was epidemic and manifested in plethora of dysfunctional 

behaviors. For example, from a management perspective, data for 

decision making is fundamental. In this case each department and 

iubunit had lli Own separate infurmaUQn ^yblaivi. Teuhnical 

Berviciei did nut hfivb ail iififurmatlun hyhim thai uoUeyted, 

aggraoated, and monitored produailvi ty data in a systernatig faihiuh. 

There were many profe&aional forms and data bhikla throughout the 

library. A cursory review had suggesteu that the elaborate data 

collection system was effective. Aftfer a f^w informai interviews with 

the librarians, however, we learned of their frustration with the data 
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collection system. Since they worked in discrete units or departfnents . 
they uimrm unable to identify the source of the prDfalem. Ule vieujed the 
lyitem hollstically and attempted to track books through the entire 
system. We ©bserved immediately that forms used to collect statistics 
uara not designed to reflect management information needs. The 
Catalog Department aggregated copy, original, and variant edition 
categories into a single category — titles. This practice hid the 
variation igithin each category, that is required to identify where 
a production problem exists. This type of problem was endemic to the 
entire system. 

We recommended a management information system including^ 
well-defined goal^ and objectives (including numerical Qoals h input 
and output data to measure uorkflowi output standardsi a measuring 
device to account for how staff allocated their time to complete 
tasksi a feedback signal or monitoring component to evaluate their 
progress towards specified goalsi and a protocol for corrective action 
(Barrett and Silver 1 SEE ) . CylturaUy, we also recommended that 
management attempt to reinforce the subcultures rather than waste time 
attempting to crush specific subcultures. We believed that it was 
important to 

Encourage each subculture to enrich its own cultural 
life. Rather than be afraid of subcultures pulling 
apart, a symbolic manager will seek to strengthen each 
subculture as an effective cabal within the overall 
culture. Thus, he or she will often attend functions 
called to celebrate a particular subculturei participate 
in special awards for the heroes of the subculturei and 
generally endorse the subculture*s existence and meaning 
within the larger culture (Deal and Kennedy 1982, p. 

CDmmittees formed of members from various subcultures Joined to address 
common problems. This served to sensitize chem to each others concerns 

IS 
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and problems, Th« emphasis was on using subculturea to enrich the 
larger culture. The effectiveness of this recompfiendai ion was limited by 
the weakness of the existing cultural syitem. However, it was 
succassful in reducing the existing tension for a majority of the 
subcultures in the library, 
Superviaion 

The supervisory system also needed improvement in the library. The 
most significant areas of weakness includedi standards of performance 
and evaluation and span of supervisory control over staff. The 
standards of performance and evaluation criteria were not explicit or 
commonly understood. This led to inconsistent appraisals and 
misevaluat ions , resulting in what appeared to be inappropriate 
terminations. 

If people tend to see the firing as arbitrary and 
unfair, they become confused and upsei. In one fell 
swoop, the culture is called into question (Deal and 
Kennedy 1 982 , p . 73 ) . 

The lack of clearly established and mutually agreed upon goals and 

standards unnecessarily exposes management to charges of perceived 

inequities or capricious decision making. Once consistency and the 

foundation of due process is established, rituals are useful tools 

to ameliorate untoward effects of appropriate but 

uncomfortable transitions. 

To bring these disturbing events under control , 
sophisticated companies provide elaborate rites. The 
rituals not only provide security during an unwanted 
transition but also put the culture on display and 
dramatize and reinforce its values and beliefs. Those 
managers who don't consider the dramatic aspects of a 
transition ritual will miss an opportunity to use it to 
extend the culture's influence (Deal and Kennedy 1982, 
p. 73). 

The problem was clearly linked to poor leadership. A brief historical 



review, based on archival data such as employe^^ent records and informal 
interviews, revealed that there had baen a high degree of turnover 
in managament positions. According to the Associate Director, 

the circumstances includad four changes in (Catalog!^ Department Chiefs 
in the past five years, a change in the Associate Directorship four 
years ago, and three changes in the Original Catalogino Unit Head's 
position. In addition, the Chief of the Catalog Department and the 
Acquisitions Department had only been at Stanford for approximately two 
years at the time of the study. This degree of turnover resulted in 
d lack of continuity in leadership and In management expectations of 
staff performance. This in turn was linked to staff concerns and an 
unclear understanding of their roles, 
UJork space 

An ethnographic audit vieuia the physical environment as part of the 

cultural system. Workspace in Technical Services ujas not conducive to 

an efficient production Uiorkflow. The limited space available was 

poorly organized. Equipment was not located in a manner that 

aontributed to efficiency. In addition, the lack of privacy, noise. 

and poor air circulation were not conducive to efficient operations. 

This contrasted with the plush new offices of the public service 

librarians who worked with students and professors at the 

reference desk, the computer terminals, and In the stacks. 

Discrepancies in the way physical sites are arranged for 
different classes of employees is one sure sign of a 
weak or fragmented culture (Deal and Kennedy 1982. p. 
130^131 ). 

Participant observation was Instrumental in sensitizing us to this 
problem. We studied the library culture for over mix months. We were 
involved in their daily lives. Every day we would interview staff, eat" 
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iunch uiiih xh&m , and pflriodiQally help tham with an acquiiition or 
cataloging task. The validity of their complaints reQarding work ipaee 
inadequacias eouid be eaaily verified during daily observation, 
dDCUPiantation of physical traoes ( includino poor lighting , craMpad 
quartars, and poor air circulation) and part icipat ion in thair uiork 
livas. In addition-, the ethnographic auditor took tha tine xo 
intervleui librarians at various coriparable resaarch libraries 
throughout the Unitad States and laarnad that this particular confliet 
was part of tha largar raseareh library culture. This particular 
eonfliot, inoluding tha physical nam fsstat ions repr^isented in 
work space conditions, were typioal of tha ralationship batween 
technioal servioa and p-iblia servlee librarians in research 
libraries throughout the United States. Nevarthalass , an athnographic 
auditor is a change agant who attempts to move their organisation 
bayond the status quo. In this ragard, ua raconmanded axtenaive 
renovations of the workspace (which are baing completed at this tine) 
to alimmata the vast discrapanoy batween tha plush surroundings of 
tha public servioa librarians and tha "sweatshop" conditions of the 
technical sarvice librarians, Tha dlaorganiEad work station 
arrangement compounded the problam and rapresentad an additional 
manifastat ion of the cultural disarray in tha organization- All of 
these maladaptive pattarns impadad productivity. 
Chemistry 

The Chemistry Dapartmant of Stanford University is responsibla for 
providing undargraduata and graduate leval acadamic instruction. The 
Chamistry Dapartment provides raquirad ooursas in tha School of 
Humanities and Sciences and in the School of Hadicma. In addition, the 
department's research andaavors have received intarnat lonal acclaim, 
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The Chemistry Department ia under the administrat i va umfaralla of 
Hunanltias and Sciences. The Chairman of the Chemistry Departmant 
reports to the Dean and the departmental Administrative Manager reporta 
to the Chair, The ndminiitrat ive nssistant , tuJo Office Asststanti, and 
the hccountant, report directly to the departmental ndninistrailve 
Manager, Service center staff memberi <five) report to the 
Administrative meslstant. 
The Assessmenj 

The assessment of this department uaa positive from an ethnographic 
auditing perspective. However, the same department yould have been 
evaluated as hopeless from a c©nventional audit or evaluation 
perspective. 

The ethnographic audit concluded that significant progress had been 
made since the current staff took control of the Chemistry Department's 
administration. The organisation and maintenance of budgetary records 
represented one of the most noticeafale improvements made by the new 
staff in the department. Monthly expenditure siatementi, requisitions, 
and other related fiscal records uiere readi y acoesiible and amenable to 
analysis. This compared favorably yith the haphazard organization and 
maintenance of fiscal records for the years under the preceding 
departmenial admini sirai ion , In this oase , dated archival data such as 
budgets, personnel records , requisitions, and property equipmeni reoords 
provided documentation of the differenee betueen the old and neuj 
management behavior patterns. 

From an audit perspective, this was a good beginning. From a 
auitural perspective, this was a significant feat in itself, h basic 
set of work rituals had been established. The rituals gave everyone a 
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sanae of security about yhat they uera doing, 

Frevaiiing ideas about ihm importance of tangible 
result a in buiineas obscure the ri tualiit ic part of 
ui or R f B m 

...Uniika social exehanges , work rituals do not produce 
direct results, but they are Just as valuable because 
they provide a sense of security and common identity and 
assign maaning to mundane activities. 

In a way, of course, it is the business of culturei 
it provides a way for people to justify a belief in 
their own self^worxh and that of their work. But work 
rituals are important to the company as a whole. They 
sionai to the outside world Just how effective the 
culture is, especially if the product is intangible. By 
reGognizlng this importance, companies can use work 
rituals to help build a strong culture that will produce 
even better results (Deal and Kennedy I iSZ . p. 

From an ethnographic audit perspective, this was an achievement, a 
manifestation of their new cultural strength and sense of identity and 
purpose. This was worthy of mention in the audit report. However, it 
would have gone essentially unnoticed in a conventional audit or 
evaluation of the department. 

There was still more to be done to establish fiscally stable 
operations in the Chemistry Department, The absence of long-range 
planning and indecision were the two most significant obstacles that 
Impeded the establ ishement of stable and predictable fiscal affairs. 

TKere were no established academically and administratively 
integrated long-'range plans regarding departmental program activities. 
There were no corresponding sets of goals, objectives, and timelines to 
guide and monitor departmental plans on various levels. Another 
fundamental obstacle that significantly detracted from departmental 
operations was indecison and lack of f ol 1 ow^through , There were 
numerous short range plans that were well researched and reflected an 
accurate understanding of departmental needs. Unfortunately, few of 
these well designed plans were implementad. These types of decisions 
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and iubsaquent actions ranged frori budget forecasting and service canter 
charge-out ratea to service center financial bookkeepina practical. The 
problan of indecision and lack of f ol low^t hrough also ej^tended to the 
dovalopment of a formal syitem of yrltten personnel evalustions. 

Their single most significant fiscal ujeakness in the department yas 
that they had no concept of the future. There ware no formal yritten 
projections for any of the Chemistry Department's budgatsi 
administrative aperating budget , undergraduate laboratory budget, or the 
service center budgets, Uritten projections are useful tools to monitor 
finances and should be used as a signal to adjust spending habits. The 
purpose of forecasting is to project end^of--year spending based on 
current fiscal behavior. Projected overdrafts serve as a signal to 
alter one*s current fiscal behavior to enable the dapat tment to close 
the fiscal year yith a balanced budget. This lack yas compounded by the 
mi^ed messages the department received frDm administration - messages 
that inadvertently fostered fiscal irresponsibility and dependency. 

The Chemistry Department had been operating according to a de facto 
administration subsidization plan. Charge--out rates in the servica 
centers were set at an artificially loy rate that resulted in 
predictable overdrafts. These overdrafts yere routinely subsidized by 
administration at the close of the fiscal year* The Chemistry Department 
needed to make a conscious decision to either set Chemistry Stores mark- 
ups at the percent needed to reflect actual costs or request 
administration subsidization in advance to offset this mark-up and to 
prevent overdrafts and de facto administration subsidization that is not 
budgeted. 

Our oyn service center projects indicated that Printing, 
ei assbloying, and Microanalyt ical service centers required immediate 
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attention t© offsat projections. Another sarvico center had no income 
or expectation of forthCQming funds to operate it. Hoyever , its 
operating coat yes projected at over $100,000 a year. In this caie the 
data provided by their managerient infornation system yaa accurately 
collected and simply presented, but no one paid any attention to the 
report. The information provided a signal that they were underfunded 
and should either request funds from administration, have the faculty 
subsidize the shop with research grants, or close down. In making no 
decision, the management made a decision with serious fiscal 
consequences. At the same time, decisions regarding budgetary matters 
are not cast in stone, Mark-ups, for eKample, can be variable as 
compared yith fixed percentages. The fiscal rationale for any change in 
charge^out rates, hoyever , should he documented and verifiable, As 
stated earlier, adnlnstrat ion had developed a pattern of absorbing the 
deficit and saoldlng the department at the end of the fiscal year. The 
combination of available information and this form of de facto 
subsidiiat ion created additional confusion, distrust, and resentment 
between the department and the administration over the years. The 
fault, however, was management's < on both sides) for not paying 
attention to early projections of the department's expendi tures , 
Management information systems are informational in nature ^ " they 
inform decision making and signal the need for declsionsi they are never 
a sybstitute for management decisions. 

The department was like a ship without a rudder - aimlessly adrift. 
There were no shared values about the present. Therefore, it yas 
impossible to project for the future. Moreover, the implicit cultural 
values communicated to the department yere inadvertently paternalistic 
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and served io weaken the department's cultural system^ Our FindinQs 

were based on traditional finanGial archival data Includina departmental 

and adnlnAstrat ion budoet records and correspondenca . In addition, a 

variety of financial calculations yere required to ealculate appropriate 

nark-up rates. Informal intervieuis uiith both departments provided an 

insight into the distrust and resentment that this cultural practice and 

structural arrangement had created* 

We recommended the use of fiscal projections using accounting 

software oyned by the department to addreas their immediate needs. They 

provided reliable projections, Weiohted projections yere recommended to 

accurately reflect the budget cycles for each service center. A more 

significant recommendation emphasised the necessary to re--establ ish 

departmental priorities and make the necessary budgetary decisions 

required to stay uithin the budQet , Mark-ups for the service centers 

had to be re-examined and ad.lusted to reflect actual costs. Ue also 

recommended that serious consideration be fliven to securing more 

competitive prices from outside vendors for glassbloujing and 

microanalyt ical products. In addition, it yas necessary to consider 

closinfl down one of the service centers. Their responsiveness to our 

recommendations throughout the audit (adoptino 80% of the 

recommendations during the audit) was a more Important Indicator of the 

department's health than the projected ©verdrafts. It symboliied a 

vibrant, healthy cultural system - able to adapt to its environment. 

Strong cultures are not only able to respond to an 
environment , but they also adapt to diverse and changing 
circumstances (Deal and Kennedy 1982, p, 195). 

As noted above, the problems illustrated by this department yere 

symptoms of a larger disorder In the cultural system. fln ethnooraphia 

audit provided a holistic viey of the problem, Communication betyeen 
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the dsparinerit and administration represented the neKt level of analysis 

required tg identify the iour-ce of this cultural malaise. 

There ig a fnutyally interdependent relationship between the 

Chemistry Dapartment and the adniniitrat ion • The atrenflth or i^eaknasa 

of this relationehlp is dapendent on a healthy uorking relationship and 

constructive aammunicat ions 

In a strong culture, the ( oornmunicatlon ) network is 
powerful because it can reinforce the basic beliefs of 
the ©rganiiation , enhance the symbolic value of heroes 
by passing on stories of their dQeds and 
aocDmplishmenti , set a new climate for change, and 
provide a tight structure of influence for the CEO (Deal 
and Kennedy 1982, p. 8S^8B). 

During our review of interdepartmental comnunica Uons , we observed 

that communication between the Chemistry Department and administration 

had been less than satisfactory on both sides. The communication 

problem was most problematic on the implementation level between the 

Chemistry Department and administration. The most important area In 

which communication had been a problem was in budgetary affairs. 

Information was routinely communicated verbally without written 

documentation to follow up and record agree enti or disagreements. The 

Chemistry Department accountant and fiscal affairs officer in 

administration had only met once to discuss budgetary matters, 

Horeover, the Chemistry Department was not convinced that a 

reasonable budget had been negotiated with administration. In this 

regard, the rationale for determining the budget appeared unclear and 

inconsistent. In principle, this year's budget is comprised of last 

year's allocation — plus inflation and some minor adjustment. In 

practice, however, there was no apparent recognition of actual 

expenditures in determining neKt year's budget. For example, repair and 
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naintenanee, photocopy, and talephone faudgeta were reduced even though 
last year's actual expenses aKcaadad lom© of the budgets* 

Administration had not clearly and consiitently communicated their 
fiscal policy based on limited resources and equity. For eKample, 
verbal communicat ioni fram adminiitration admonish the praatice of going 
into overdraft. However, this ii belied by the practice of routinely 
abiorbing yearly averdrafts u/ithout sanction for the pait 14 years. 
Moreover, admini itrat ive e^^pectat ions yere often perceived as implicit 
rather than explicit, A substantial transfer from administration to the 
Chemistry Department yas promised to support service center operations 
savaral months before the audit, Hoyever , an audit memo ujas required to 
expedite the transfer. 

There uias ample documentation to suggest that the delay in 
transferring these funds was a function of poor communication and 
implicit expectations. Administration appeared to be waiting for the 
delivery of Chemistry's service center budgets - which ujere overdue. 
This rationale, houjever , was not dispelled or explicitly communicated to 
the Chemistry Department, 

There were two additional situations that were indicative of the 
poor level of communications between the Chemistry Department and 
administration. First, administration did not respond to a Chemistry 
memo requesting additional staff. The memo was addressed to the wrong 
administrative officer (who worked two doors down the hall in the same 
office). This was perceived by administration as not going through the 
proper channels. Nevertheless, Chemistry's first awareness that it had 
committed an C intentional or unintentional) administrative faux pas was 
when it called administration about the specific problem. This 
situation evidenced poor understanding of adminstrat i ve hierarchy and 
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£ eiai QrganUat ion , as yell ai a faulty machaniam for a©rracting 
improperly routed departmental information. 

Similarly, the Chemistry Oepartmant used departmental operating 
funds to purchaie furnityre. Normaily, furniture ii purchased for 
departments by administration. This was a consciQus departmental 
deeiiion and thus a manifestation of poor relations as well as 
somnunidat ions betyeen the Chemistry Department and administration. 
Conclusion 

University management is greying increasingly interested in the 

appraisal of organizational culture. Organizational culture consists of 

the shared beliefs and behavior patterns of an organization that enable 

it^ members to function and adapt to new environments. Identifying 

adaptive and maladaptive patterns of behavior on the organi lat ional 

culture level has a long-term, holistia. and often incalculable impact 

on an academic institution. Ethnographic audits and evaluations of 

organisational culture question basic assumptions about management 

policy and practice in higher education. 

Ethnographic auditing penetrates the surface of administrative 

knoyledge. Noam Chomsky (1972), the prominent linguist depicts in his 

york LanQuaoe and Mind a surface and a deep structure of language. The 
3 

model can be applied to management as yell. This is most graphically 
illustrated by one of the auditor's most c ofnmon tasks — revieying 
spreadsheets. Auditors are trained to analyze the grammar of an 
electronic spreadsheet. Syntactic errors in spreadsheets that may have 
long range effects can be detected and remedied. The surface 
calculations of an electronic spreadsheet print-out provides an 
elementary insight into management practices. Quastloning the 
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appropriateneis and accuracy of underlying formulai scntalnad in sach 
cell, as well aa the format of the spreadsheet itself provides insights 
on a much deeper and more abstract level. In esience, ethnographic 
auditors can understand the meaning of management. 

tthnographic auditing is a useful research appraaGh to management 
and academe. It also fills a void in the organizational research 
literature regarding strategiei of action (see Peterson 1985), 
Ethriographlc auditing is an eMcellent preparation for individuals 
planning to ent er advocacy research or admin J strat i ve careers* 

An understanding of the culture of an organisation facilitates an 
evaluation of organizational culture in an academic institution. 
Cultural knouJledge and cultural indicators guide audit concerns and 
shape audit racommendat ions . Similarly ^ focusing on reiource control 
increases the reievance of organisational resaarch to management. 

Management is an area that has been studied using traditional 
evaluation and ethnographic techniques, but has yielded insufficient 
insight into the dynamics of educational management. Ethnographic 
auditing focuses on educational and administrative management elements 
of an institution. Ethnographic auditing is able to interpret the 
ledgers, processes, and procedures of management that serve to 
facilitate or to inhibit the academic mission. 
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Notes 



t. See Mayhew U979, pga, 116^119) and Karol and Sinaburg (1980, pgs i 
220"222 > regardinQ an aduGational Init I tut ion ' s acadenio nisgion, 

2. SGhall (1983, p,557) dsflnas organliat ional culture as^ 

a ralativaly enduring, intardepandant aynboUa syatan of valuaa , 
beliafa, and asaumptiona evolvinQ from and imperfactly aharad by 
interacting organliat ional mambera that allows than to exp la in . 
Goordinata, and avaluata behavior and to aaeriba common neanlnda to 
atimuli ancountared in the organisational conteKti thaaa funat ions are 
acGompliahad through tha radiation of implicit and aNplicit rulaa that 
act aa cultural f^jarranta. 

3. This analogy is based on tha work of lingulatic tranaformatlonallata 
in r^ferenc^ to basic semantic qualitites of language in Ju>ctapoal t ion 
to aimpla structures of aound and morpheme. This analogy is not tied to 
the antaQuated but useful deep struoture hypothasis proposad by Fodor 
and Katz < 1 964 ) and H.aiz and Postal <t964)t Also saa Donald Light 
<I37§) ragarding "surface data and deep structure'' analoglaa regarding 
organizat ional research , 



DEST COPY AVAi.U.&LE 
31 

29 



REFERENCES 

Brink. y.Z. M2H«ra Int^m^; A,_,d.*,Mni Ansfai^inn nn^r-^t.^p. ^ 

Bowen, H,R, Socislly Imoosed Costs of HiQhor Sducation. In n. H^nrv 
Lectures . ^a"^ ' R^-tr-^nr-hm^nt ^nj ReaBOra i ^.i. 1 f ThP arimi n I ^ t f ^ t . »^ 

ax higHgr saugaUog . Illinoisi University of Illinois Pi-ess . 1979. 

Chomsty, N, Laimiiifla ttiad. New Yoi-f, : Hare our t . Brac«, iq??, 

Fetterman, D.M. ethnograBhy in Educatlnn^l Evaluation . ieverly HUli 
CA: Sage Publications, 1984. 

~ Operational Auditingi A Cultural Approach. Tha Intarnal 

Auditor .1985, 43(2 )148-54. - , _ 

Fetterman, D.M. and Pitman, M.A. Educational Evaluationi Ethnonr^nhs. in 
' ■ Practiap jn^ PoUtica . Beverly Hills, CAi Sage Publications. 

Fodor, ,J,A,, and Katz. J, J. («d8.>, Thm Btruni.nf^m q± Lanou^nw.- 
^"^'''"'1^ Phi In^nnhy of Lann.mnB. Enolewood Cliffs N.J.i 

Prentice-Hell , 19S4. " ' 

Garrett, L, andM. Silver. Produf-tlnn Manao»m.^nt An^lvsi^ . Sscond 
Edition, New YorN s Harcourt , Brace. Jovanovich . Inc. igSS, pg, 11. 

earvln. 0. Thw Fgnnom,r^ of Unlv^r^itv Behavior . NYs Acaen i C Pras S . 
} 980 * 

eiaser. B.(3. and Strauas , A,L, Tha diornvwrv of ornimd^d thworv ; 
gtrateqlBW for nugU t^tjvw research . Chi-aao: Aldine, 1957. 

eoffnan. E, ?tiqP!<>i UoiMS. on the flanao^ment of Sooi led Identity . 
Englewood Cliffs, N J : Prent ioe-HaU , Inc. 1983, 

Quba, E,e, Criteria for assessino the trustMiorthinegs of naturalistic 
inquirlas. Fdyr gtigng} Qowwuntc-^itton flnri Technolonv 29< 7 ) . I 98 1 . pp . 

gPBltn^lMn at a nodf 1 . Unpub listed dodtoral dissertation. 
Bioonington, IN: Indiana Univarsity, 1983, 

Hopkins, D.S. and y.Fi Massy Plannlnn Modftif for ZoWmt^mm and 
Univef-^i t iff^. Stanford, GAi Stanford University Press , 1981, 

Jadamus , P., Patarson, M, , end ftssociataa Tffinpnvinn Acad^mM 
P£MS4^ati San Francisco. OA: Jossay^Bass Publishars, 19801 

Harol , and S, Slnsburg HanaQtna the Hinh^r gHfifi^tinn EntePorMi^ , 

NVi .Jc^>^n i^iitiy and Sons, 1980, 

Kati, J, J,. #*vd Postal, P.M. An Tntaor^tw^ Thgarv ^ Ltnnui^t if- 

BEST COPY AVAILABLE 32 .^^ 



ERIC 



nf^Bgryp^tinna. Gambrtdao, Mflis , : M,I,T, Preaa , 1964, 

Llnfloin^, Y.S. and Guba , f.G, istablishlng dependability and 
aanfifMblllty in naturalistic inquiry through an audit. Paper 
prasanted at th© Af^«rican iducational Research Association , Anuual 
Meat 1 no. Now York, NY, March 1982, 

Matthaws. J.B. EfgsaiiVS lias of Hano^^^^n^ Cgn^ultants in Nfqfi^ 

Edyga^qn. Boulder, CQloradoi National Canter for Higher Education 
Planegement Systems, 1983, 

Hayhaw, L. Survlvtnn thm ginht iRw. San Franc iaco , CAi Jossev^Baea 
Publishers, 1379, 

MoCorkle, CO. , and S,0, Archibald Hanaa#iFi^nt and Leadgr-^HIn Higher 
FHiinat if^n. San FrancisGo, Cfi\i Jossey Bass Publishers, tSBZ, 

Miles, M,B, and Huberman , Qualitative Data AnalvR j^i ^ SQurcahnnk 

g± NffM Methods. Beverly Hills, CA^ Sage Publications, 1984, 

Patton, lliQ, quail t at iva Evaluatinn Hat hods , Beverly Hills O^i Sage 
Publications, 1980. 

Peterson, HtW, Emerging Developrnents in Postsecondary Organization 
Theory and Research^ Fragmentation or Intagratlon, Edueationa 1 
Rqaearnhar 1 98B , 1 4 , ( 3 ) , pp . 5- 1 2 , 

Riasnan, 0, Can We Maintain Quality Sraduate Education in a Pariod of 
Retrenchment, In Di Henry Lectures, Conf 1 inj Betrmnnhm^rit and 
R*anpi-^ j s^f 2 The adffiinistrat ton nf hinher edu^at inn , Illinolsl 

University of Illinois Press, 1979* 

Rittanberg, Li Audi tnr indanenri«nna and gyst^Wjn rtmminnm . Altapionte 
Springs, FLi Institute of Internal Auditors, 1977, 

Sawyer, L.Bi The Pract iea of Morigrn Internal Audi t i nq . Altanont 
Springs, Institute of Internal Auditors, 1981, 

SGhall , M,Ss A Cofimunicat ion^rules Approach to Organizational Culture-. 
Adwini.^trat 1 va Sc^ fngg^ Quarterly . 28, 1983, pp. 557-581. 

Schwandt, T»A, and Halpern, E,S= Qualitative Evaluatlonr Achieving 
Ri§Dr Through Auditing Proceses and Outcomes, Evaluation 1984 
Presassion, presented at the Evaluation Rasearoh Society/Evaluation 
Natwork Annual Maeting, San Francisco, CA , October ig84t 

Taylor, S,-!, and Bogdan, Introduet i on to QuaHtattva Ra^^aarnh 

ilQthgdtv IM ^Mr_Qh Inc, hmmmnnm. New York ^ John Wiley and Sons, 
1984. 

Van Maanen, J, (Ed,) Qi|^] j tfi^ ? vft Meth^'lnl ngy , Beverly HiUa, CAi Sage 
Publications, 1983, 

Wolotklewici, R.J, CoHinnw Administrator Handbook . Boaton' Allyn 
and Bacon, Inc. 1980, 

33 3, 



